#SQL SELECT

[rajaniesh]

Unlocking the Full Power of Apache Spark 3.4 for Databricks Runtime!

You've dabbled in the magic of Apache Spark 3.4 with my previous blog "Exploring Apache Spark 3.4 Features for Databricks Runtime", where we journeyed through 8 game-changing features

You’ve dabbled in the magic of Apache Spark 3.4 with my previous blog “Exploring Apache Spark 3.4 Features for Databricks Runtime“, where we journeyed through 8 game-changing features—from the revolutionary Spark Connect to the nifty tricks of constructing parameterized SQL queries. But guess what? We’ve only scratched the surface! In this sequel, we’re diving deeper into the treasure trove of…

[t-ierrahumeda]

Ded. I've got work in 40 minutes and I don't wanna. Plus I saw my boss did some modifications to the documentation I worked so hard for at....0:00. Like dude do you not sleep also what is wrong with my analysis. Fuck you

[prettyboykatsuki]

fang u inspired me to play seekl and learn some sql as a result and its. so fucking delightful . what the hell . i want to write for odxny now i hate you (affectionate)

I LOVE U SEEKL I LOVE U SQL AND I LOVE U ODXNY . hes sooooo cute to me i need to eat him alive so genuinely

[se-emily]

【7分で分かる！】基本をおさえるSQL入門講座！

[palesquash]

This… this is absolutely hilarious

Not to mention the egregious privacy violations and danger this presents to people by consolidating this huge amount of data, but it’s simply not possible if you’ve worked with data at all.

I’ve worked in databases for the better part of 10 years in enterprise settings, to even think that you can just “hook up” 25 different databases systems and build this “master” dataset on Americans is hilariously short-sighted

“These systems don’t talk to each other” Yeah you realize the entirety of the American government is just a giant jenga tower that *sometimes* function coherently. Add 50 years of database technology and different administrations and it’s marvelous that anything gets done at all.

A project of that scale would require a cooperation across multiple government sectors, rethinking entire technology solutions, migration, storage, security (lol), and data transformation. Not to mention third party stuff, apis, and the physical manpower required to do this sort of knowledge work

Seriously it’s not like there’s a python script sitting on someone’s desktop that says

import * from government

I mean, do they care about any of that? Probably not, it’s all a big grift and they will say what they want to say. But I can rest easy a little bit knowing that this task is not physically possible. With a well coordinated plan and multiple years of work? *maaaaybe* With a gaggle of idiots that think people are 120 years old cashing social security checks? Absolutely not

[bravehartk2]

SQL: Query after GUID field

This tiny code snippet demonstrates how to query for GUID fields in SQL by using string values, contrasting it with the MySQL approach.

[simple-logic]

#PollTime Which SQL command do you use most often? 🧐SELECT 🤝JOIN 🔄UPDATE ❓WHERE

Which SQL command is your go-to? 🤔 Let us know in the comments below! 👇

[nicolae]

SQL - SELECT: GROUP BY - Inspectarea grupurilor

După ce am definit grupuri cu cuvântul cheie GROUP BY, putem selecta mai multe informații despre fiecare dintre ele, de exemplu: câte persoane (rânduri) există în cadrul fiecărei familii (grup de rânduri)? SELECT lastname, count(*) -- count() este o funcție care numără valori sau rânduri FROM person GROUP BY lastname; Vedem că în micul nostru exemplu de bază de date există o familie cu trei…

[thedbahub]

The Performance Trade-offs Between SELECT * INTO and SELECT THEN INSERT in T-SQL

In the realm of SQL Server development, understanding the intricacies of query optimization can drastically impact the performance of your applications. A common scenario that developers encounter involves deciding between using SELECT * INTO to create and populate a temporary table at the beginning of a stored procedure versus first creating a temp table and then populating it with a SELECT…

[therealaysha]

a jack off all trades is a master of cum. is anyone here

[rajaniesh]

Exploring the Latest Features of Apache Spark 3.4 for Databricks Runtime

In the dynamic landscape of big data and analytics, staying at the forefront of technology is essential for organizations aiming to harness the full potential of their data-driven initiatives.

[ay4hlive]

Konsep View

View dalam database adalah objek virtual yang terdiri dari subset data yang berasal dari satu atau lebih tabel dalam database. View menyediakan cara yang terstruktur dan terorganisir untuk melihat dan mengakses data yang relevan dengan kebutuhan pengguna. Berikut adalah beberapa hal penting tentang view dalam database: Definisi View:View didefinisikan menggunakan pernyataan SQL (Structured Query…

[prettyboykatsuki]

as a comp sci student i love ur tagging system it scratches my brain so good

idk why but im kind of surprised so many people have recognized it and im glad people like it..... i am quite fond of it myself..... also fellow compsci student!!!!

[lazeecomet]

The Story of KLogs: What happens when an Mechanical Engineer codes

Since i no longer work at Wearhouse Automation Startup (WAS for short) and havnt for many years i feel as though i should recount the tale of the most bonkers program i ever wrote, but we need to establish some background

WAS has its HQ very far away from the big customer site and i worked as a Field Service Engineer (FSE) on site. so i learned early on that if a problem needed to be solved fast, WE had to do it. we never got many updates on what was coming down the pipeline for us or what issues were being worked on. this made us very independent

As such, we got good at reading the robot logs ourselves. it took too much time to send the logs off to HQ for analysis and get back what the problem was. we can read. now GETTING the logs is another thing.

the early robots we cut our teeth on used 2.4 gHz wifi to communicate with FSE's so dumping the logs was as simple as pushing a button in a little application and it would spit out a txt file

later on our robots were upgraded to use a 2.4 mHz xbee radio to communicate with us. which was FUCKING SLOW. and log dumping became a much more tedious process. you had to connect, go to logging mode, and then the robot would vomit all the logs in the past 2 min OR the entirety of its memory bank (only 2 options) into a terminal window. you would then save the terminal window and open it in a text editor to read them. it could take up to 5 min to dump the entire log file and if you didnt dump fast enough, the ACK messages from the control server would fill up the logs and erase the error as the memory overwrote itself.

this missing logs problem was a Big Deal for software who now weren't getting every log from every error so a NEW method of saving logs was devised: the robot would just vomit the log data in real time over a DIFFERENT radio and we would save it to a KQL server. Thanks Daddy Microsoft.

now whats KQL you may be asking. why, its Microsofts very own SQL clone! its Kusto Query Language. never mind that the system uses a SQL database for daily operations. lets use this proprietary Microsoft thing because they are paying us

so yay, problem solved. we now never miss the logs. so how do we read them if they are split up line by line in a database? why with a query of course!

select * from tbLogs where RobotUID = [64CharLongString] and timestamp > [UnixTimeCode]

if this makes no sense to you, CONGRATULATIONS! you found the problem with this setup. Most FSE's were BAD at SQL which meant they didnt read logs anymore. If you do understand what the query is, CONGRATULATIONS! you see why this is Very Stupid.

You could not search by robot name. each robot had some arbitrarily assigned 64 character long string as an identifier and the timestamps were not set to local time. so you had run a lookup query to find the right name and do some time zone math to figure out what part of the logs to read. oh yeah and you had to download KQL to view them. so now we had both SQL and KQL on our computers

NOBODY in the field like this.

But Daddy Microsoft comes to the rescue

see we didnt JUST get KQL with part of that deal. we got the entire Microsoft cloud suite. and some people (like me) had been automating emails and stuff with Power Automate

This is Microsoft Power Automate. its Microsoft's version of Scratch but it has hooks into everything Microsoft. SharePoint, Teams, Outlook, Excel, it can integrate with all of it. i had been using it to send an email once a day with a list of all the robots in maintenance.

this gave me an idea

and i checked

and Power Automate had hooks for KQL

KLogs is actually short for Kusto Logs

I did not know how to program in Power Automate but damn it anything is better then writing KQL queries. so i got to work. and about 2 months later i had a BEHEMOTH of a Power Automate program. it lagged the webpage and many times when i tried to edit something my changes wouldn't take and i would have to click in very specific ways to ensure none of my variables were getting nuked. i dont think this was the intended purpose of Power Automate but this is what it did

the KLogger would watch a list of Teams chats and when someone typed "klogs" or pasted a copy of an ERROR mesage, it would spring into action.

it extracted the robot name from the message and timestamp from teams

it would lookup the name in the database to find the 64 long string UID and the location that robot was assigned too

it would reply to the message in teams saying it found a robot name and was getting logs

it would run a KQL query for the database and get the control system logs then export then into a CSV

it would save the CSV with the a .xls extension into a folder in ShairPoint (it would make a new folder for each day and location if it didnt have one already)

it would send ANOTHER message in teams with a LINK to the file in SharePoint

it would then enter a loop and scour the robot logs looking for the keyword ESTOP to find the error. (it did this because Kusto was SLOWER then the xbee radio and had up to a 10 min delay on syncing)

if it found the error, it would adjust its start and end timestamps to capture it and export the robot logs book-ended from the event by ~ 1 min. if it didnt, it would use the timestamp from when it was triggered +/- 5 min

it saved THOSE logs to SharePoint the same way as before

it would send ANOTHER message in teams with a link to the files

it would then check if the error was 1 of 3 very specific type of error with the camera. if it was it extracted the base64 jpg image saved in KQL as a byte array, do the math to convert it, and save that as a jpg in SharePoint (and link it of course)

and then it would terminate. and if it encountered an error anywhere in all of this, i had logic where it would spit back an error message in Teams as plaintext explaining what step failed and the program would close gracefully

I deployed it without asking anyone at one of the sites that was struggling. i just pointed it at their chat and turned it on. it had a bit of a rocky start (spammed chat) but man did the FSE's LOVE IT.

about 6 months later software deployed their answer to reading the logs: a webpage that acted as a nice GUI to the KQL database. much better then an CSV file

it still needed you to scroll though a big drop-down of robot names and enter a timestamp, but i noticed something. all that did was just change part of the URL and refresh the webpage

SO I MADE KLOGS 2 AND HAD IT GENERATE THE URL FOR YOU AND REPLY TO YOUR MESSAGE WITH IT. (it also still did the control server and jpg stuff). Theres a non-zero chance that klogs was still in use long after i left that job

now i dont recommend anyone use power automate like this. its clunky and weird. i had to make a variable called "Carrage Return" which was a blank text box that i pressed enter one time in because it was incapable of understanding /n or generating a new line in any capacity OTHER then this (thanks support forum).

im also sure this probably is giving the actual programmer people anxiety. imagine working at a company and then some rando you've never seen but only heard about as "the FSE whos really good at root causing stuff", in a department that does not do any coding, managed to, in their spare time, build and release and entire workflow piggybacking on your work without any oversight, code review, or permission.....and everyone liked it

[error4343]

Ok I've had a very random train of thoughts and now wanna compile it into post.

Some MM characters computer-related (???) headcanons lol

Riley:

Has above average knowledge of Excel/Google sheets due to studying finance, but after four years with no practise forgot most of it.

The "Sooon, I have a problem" person in their family. Actually, surprisingly good and patient at explaining computer stuff to older people.

Has a higher responsibility of doing taxes (finance, after all). Even he never fails to do them right, Ed always double checks. Sometimes they get into argument, where inevitably Riley proves he is right but his father would never admit it.

Warren, Leeza, Ooker and other teens:

Also nothing outstanding in terms of skills, except few of them have interest in IT.

They have bunch of small local Discord servers and one big main server with some very stupid name.

Few times Bev tried to bring up importance of parental control over this "new and rapidly growing young community", but thanks God no one took her concerns seriously

Leeza moderates it and her moder role called "Mayor-mini". Like father like daughter.

All teens local jokes and memes were bourn/spread though that server.

Bev:

Rumors says she sacrificed her humanity to obtain such powers with Microsoft software package.

Can build up Access database from scratch, using basic SQL commands, assemble primitive, but surprisingly sufficient interface to it and synchronize it with Excel in span of one day or less.

In her laptop there're every pupil's personal file, countless Excel tables, several automatised document accounts, Google calendar with precisely planned schedule for next several months (for school, church, island and personal matters) and probably Pentagon files.

Probably can find all Pi numbers with Excel formulas.

Never lets anyone to her laptop.

Spends her free time at different forums, mostly gardening-related.

Wade:

Made a very fucking poor decision to let Bev do all the legwork with digital document accounting.

Now has no idea how some of things even work, so just goes with a flow and does what Bev tells.

No wander she got away with embezzlement.

Knows about kid's server. Very proud of Leeza for managing it :)

Because of that, he knows one or two memes from there, but keeps them in secret.

Has hobby of fixing office equipment. Does it with Sturge in spare time due to Dupuytren's contracture not letting him operate his hand fully.

Sarah:

There's no good medical technicians on island, so when something goes wrong with equipment electronics - tries to fix it herself to best of her ability.

Always monitors electronic e-shops for spare details or equipment. Grows more and more addicted to it.

Frequently updates her selection of sites with useful medical information, because Erin asked her for help guiding teens though puberty. For that receives glances from Bev, but doesn't give a shit.

Has reputation of cool aunt among kids, so she was one and only adult invited to main Discord server. Didn't accept it (doesn't even have Discord acc), but still grateful for trust.

Plays solitaire a lot.

John:

Back when he was playing Paul, Bev asked him to do something with Excel. In conclusion, poor bastard had to learn basic computer skills and Excel in span of several days. Now he is traumatized for rest of his life.

Will do all the work manually just to not touch laptop again.

Upsets very easly when does something wrong.

Doesn't own laptop. Don't give that man laptop, he will cry.

By his own will uses it only to watch baseball. Always asks someone to help with that.